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DESIGN,  ANALYSIS  AND  SIMULATION  OF  MEMORY-BASED 
CONTROL  ALGORITHMS  FOR  DUAL  RANGE  MISSILES 


Yong  D.  Song 
Associate  Professor 
Department  of  Electrical  Engineering 
North  Carolina  A«&;T  State  University,  Greensboro,  NC  2741 1 


Executive  Summary 


The  primary  objective  of  this  project  is  to  design,  analyze,  and  test  new  autopilot 
algorithms  for  trajectory  tracking  control  of  dual  range  missiles.  The  main  contributions 
of  this  project  can  be  summarized  as  follows.  First,  a  low-order  memory-based  control 
method  was  developed.  This  method  is  based  on  observing  and  generalizing  past  system 
responses  and  control  experience.  It  does  not  demand  detailed  information  about  the 
system  dynamics.  Second,  the  memory-based  method  is  integrated  with  a  partial  inverse 
dynamics  control  and  applied  to  achieve  missile  orientation  tracking  in  the  presence  of 
actuator  dynamics  and  aerodynamics.  It  is  shown  that  this  method  is  effective  in  dealing 
with  system  nonlinearities  and  uncertainties  due  to  varying  flight  conditions.  The  method 
is  also  extended  to  position/orientation  tracking.  Finally,  the  developed  autopilot 
algorithms  were  tested  via  computer  simulation. 
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DESIGN,  ANALYSIS  AND  SIMULATION  OF  MEMORY-BASED 
CONTROL  ALGORITHMS  FOR  DUAL  RANGE  MISSILES 


Yong  D.  Song 


1.  Introduction 

This  project  is  concerned  with  autopilot  design  for  dual  range  missiles.  Automatic  control 
is  essential  for  reliable  and  effective  operation  of  missile  systems.  As  conceptually  shown 
in  Figure  1,  autopilot  (Flight  Control  System)  represents  an  important  element  in  missile 
guidance  and  control.  The  function  of  autopilot  (FCS)  is  to  control  the  missile  in  pitch, 
yaw,  and  roll  motions  via  adjusting  the  surface  deflections  to  ensure  missile  trajectory 
tracking. 


Figure  1  —  Missile  guidance  and  control 

The  dynamics  of  dual  range  missiles,  heavily  depending  on  flight  conditions,  may 
experience  significant  variations  during  operation,  leading  to  nonlinearities  and 
uncertainties  to  the  system  model.  This  makes  the  autopilot  design  issue  much  more 
involved.  To  get  an  insight  into  the  complexity  of  the  problem  under  investigation,  the 
EMRAAT  (Extended  Medium  Range  Air-to-Air  Technology)  missile  is  considered. 
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The  characteristics  of  EMRAAT  missile  were  defined  in  the  late  1980’s  by  the  U.S.  Air 
Force  Armament  Laboratory,  Eglin  Air  Force  Base,  Rorida.  The  2-D  airframe  of  the 
EMRAAT  missile  is  illustrated  in  Figure  2. 


Figure  2  -  EMRAAT  Airframe,  (a)  top  view,  (b)  side  view  and  (c)  front  view 

Note  that  the  missile  of  this  type  is  a  longitudinally  nonaxi-symmetrical  airframe  with 
four  tail  fins  for  control  which  are  placed  in  a  non-cruciform.  Because  of  the  asynunetric 
configuration,  the  missile  exhibits  many  attractive  features,  such  as  high-lift,  low-drag, 
air  intake,  internal  carriage,  and  low-observability.  While  the  asymmetric  high-lift 
configuration  gives  the  missile  large  maneuverability  in  its  pitch  plane,  the  available  load 
factor  in  the  yaw  plane  is  limited.  Therefore,  to  intercept  an  incoming  target,  a  bank-to- 
tum  (BTT)  steering  strategy  must  be  employed.  The  BTT  maneuver  is  fulfilled  through 
the  control  of  roll  and  pitch  motions.  That  is,  to  achieve  the  desired  orientation,  a  BBT 
missile  rolls  the  normal  plane  to  the  desired  direction.  The  magnitude  of  the  maneuver  is 
controlled  by  pitch  control  devices.  In  contrast  to  a  skip-to-tum  autopilot  which  can  be 
designed  without  worrying  about  the  coupling  among  pitch,  yaw  and  roll  motions,  a  BBT 
autopilot  must  take  into  account  the  Coriolis  and  gyroscopic  couplings  due  to  roll  motion. 
It  is  also  imperative  to  accommodate  the  coupling  between  sideslip,  angle  of  attack  and 
roll  rates  to  achieve  rapid  and  precise  response.  Furthermore,  it  should  be  realized  that 
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most  of  all  the  aerodynamic  coefficients  are  not  constant,  but  time  varying,  depending  on 
the  flight  conditions  such  as  altitude,  Mach  number  and  angle  of  attack,  etc,  as  shown  in 
Figures  3-5.  Some  of  the  parameters  may  change  by  up  to  50%  of  their  nominal  values. 
This  is  particularly  true  for  dual  range  missiles.  Such  a  wide  range  of  change  demands  a 
highly  robust  and  adaptive  control  scheme.  In  this  project,  the  following  facts  are  taken 
into  account  in  the  design  of  missile  autopilot: 

•  Deflections  cannot  be  adjusted  instantaneously  due  to  time  delay  in  actuator 
dynamics 

•  Off  diagonal  element  in  inertia  matrix  cannot  be  assumed  to  be  zero  due  to 
asymmetric  missile  structure 

•  Aerodynamic  parameters  can  not  be  treated  as  slowly  time-varying  due  to  varying 
flight  conditions  (such  as  altitude.  Mach  number,  etc.) 


Altitude  A 


Trajectory 


Groundpath 


Figure  3  —  Dual  range  missile  flying  trajectory 


Figure  4-  Aerodynamic  force  coefficient  vs.  angle  of  attack  and  Mach  number 
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Figure  5  -  Aerodynamic  force  coefficient  C  ^  vs.  angle  of  attack  and  Mach  number 


2.  Memory-based  Control  Methodology 

In  this  project,  a  methodology  referred  to  as  the  memory-based  approach  for  missile  flight 
control  was  investigated.  The  fundamental  idea  behind  this  approach  is  somewhat 
different  from  traditional  methods.  More  specifically,  our  control  method  is  not  to  assume 
the  system  is  described  by  a  linear  model  plus  perturbations;  not  to  linearize  the  system, 
not  to  estimate  certain  parameters  based  on  the  linear  parametric  assumption;  not  to 
determine  the  bounds  on  certain  nonlinear  functions;  not  to  use  infinite  switch 
frequencies;  not  to  involve  ad  hoc  membership  functions;  not  to  run  the  system 
repeatedly  for  the  same  task.  Instead,  the  control  scheme  is  solely  based  upon  certain 
memorized  information  such  as  current  system  response,  previous  system  response  and 
past  control  experience.  Fundamentally,  the  desired  control  signal  in  the  scheme  is 
“learned”  and  generated  from  observing  and  processing  the  most  recent  experience  stored 
in  a  memory.  System  performance  can  be  continuously  improved  during  system 
operation.  There  is  no  need  to  repeatedly  run  the  system  (a  process  that  is  not  allowed  in 
missile  systems).  Another  advantage  of  this  approach  is  that  the  overall  required  memory 
space  does  not  grow  with  time  and  is  much  smaller  than  most  existing  methods  (Atkeson 
and  Reinkensmeyer  1992,  Schaal  and  Atkeson  1994). 


2.1  Information  Sets 


While  there  exist  many  approaches  to  utilizing  memory-based  concepts  for  control 
systems,  our  special  interest  in  this  project  lies  in  introducing  a  simple  method  to  build  a 
controller  using  certain  memorized  information.  To  begin,  we  introduce  the  following 
information  sets 

Su  .MpMo}  -control  history 

~  ’^*-1  *”•  >-^1  ..^o}  ■  current  and  past  system  responses 

S^.  =  ,...  ,x:j*  ,Xo|  -  current  and  past  desired  system  responses 

Here  (and  hereafter),  Wk,  Xk  and  x*k  stand  for  u(kT)  -  control  signal,  xikT)  -  state  vector 
of  the  system,  and  x*(kT)  -  the  desired  trajectory  vector,  respectively,  and  T  is  the 
sampling  period. 

Simply  speaking,  the  development  of  memory-based  control  algorithms  involves  two 
issues:  selecting  appropriate  memorized  information  and  processing  the  selected 
information.  There  could  be  many  different  approaches  to  addressing  these  issues, 
leading  to  different  types  of  memory-based  control  algorithms.  A  typical  approach  is  to 
make  use  of  all  the  memorized  information  and  process  such  information  by  the 
“weighted  average”  method,  i.e. 


where 

z  e  c  u  u 

is  a  vector  associated  with  the  stored  system  information  and  wj’s  represent  memory 
coefficients  (AfCs). 

While  the  memory-based  controller  as  shown  in  (1)  is  simple  in  structure,  it  suffers  from 
the  following  drawbacks:  1)  the  required  memory  size  may  become  extremely  large  as 
time  goes  by  because  it  makes  use  of  all  the  past  information  of  the  system  (h  is 
proportional  to  kf,  2)  due  to  large  amounts  of  information  to  be  processed  in  (1), 
extensive  computation  and  lengthy  memory  search  are  involved;  and  3)  there  is  no 
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guarantee  for  system  stability  because  the  MCs  are  not  derived  from  system  stability 
consideration. 

2.2  Proposed  Structure 

We  now  develop  a  memory-based  control  scheme  in  which  the  above  limitations  are 
removed.  As  a  first  step,  we  define  the  following  subsets 
5^  c  c  and  5^.  c  S^.  such  that 

-  {“*-1 » ••••“t-r}  ■  control  experience  beyond  r-step 

vM  JCt-r}-  current  and  r-step  back  system  responses 

5^.  =  ,x^_, , ...  -  current  and  r-step  back  desired  system  responses 

Here  1<  r  «  ik  is  an  integer.  These  sets  form  the  database  of  experience  which  are 
retrieved  and  processed  via 

U^=(f>iZr\W,)  (2) 

where 

z,  c5;©5;©5;. 

and  ^(.)is  a  mapping  function  that  converts  the  selected  information  z^into  U/^  (through 
certain  MCs).  The  difference  between  (1)  and  (2)  is  that  only  the  most  recent  experiences 
are  honored  in  (2)  while  the  past  information  beyond  r-step  is  forgotten.  This  is 
motivated  by  the  fact  that  for  a  practical  system  the  latest  system  statues  have  more 
influence  on  its  future  behavior.  Moreover,  the  selected  information  is  processed  through 
the  mapping  function  ^(.) .  Figure  6  illustrates  the  construction  of  the  first  order  memory- 
based  controller  and  Figure  7  is  a  schematic  diagram  for  memory-based  control  with 
memorized  information  up  to  step  r. 
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Figure  6  -  Construction  of  1*‘  order  memory-based  control 


Figure  7  -  The  r“'-order  memory-based  control  scheme 

One  of  the  favorable  advantages  of  the  proposed  method  is  that  the  required  memory  size 
does  not  grow  with  time  and  is  much  smaller  as  compared  with  other  methods  (e.g., 
CMAC  (Albus,  1975)  and  ACAM  (Atkeson  et  al  1992)).  To  make  this  point  clearer,  let 
us  consider  building  a  first  order  memory-based  controller.  Essentially  in  this  case  we 
only  need  the  following  information; 
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~  {“it-l} 


and 


which  is  processed/generalized  as  in  Figure  8.  Similarly,  to  construct  a  second  order 
memory-based  controller  we  only  need  the  stored  information  (Figure  9) 

~  “t-2} 


and 


S}  =  {a:. 


2,X/._lyX,^j 


As  can  be  seen,  memory  space  is  not  an  issue  here  because  the  required  memory  does  not 
grow  with  time. 


Input/State  Space  Actual  Memory 


Figure  8  -  A  first-order  memory-based  control 
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Input/State  Space  Actual  Memory 


Figure  9  -  A  second-order  memory-based  controller 

Regarding  the  memory-based  controller  (2),  if  we  view  the  memory-based  controller  as  a 
mechanism  (network)  that  on-line  processes  the  memorized  information  and  produces  a 
control  action  at  time  instant  t  =  kT,  then  the  design  of  a  memory-based  controller  boils 
down  to  specify  such  a  mechanism,  i.e.,  specifying  the  mapping  function  <|)(.)  and  the 
memory  coefficients  (MCs)  w,.  In  this  project,  we  use  the  following  mapping  function, 
among  others. 


^(cr,y)  =  ' 


l-e 


-oy  ^ 


,  <J>0 


It  is  interesting  to  note  that  such  a  mapping  function  exhibits  two  salient  properties 


0  \(/K(r,y)\<^ 

«)  lim(Z>(y,cr)->  y 
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The  first  property  allows  us  to  adjust  the  magnitude  of  the  control  signal  by  choosing  a 
proper  value  of  <7  and  the  second  property  implies  that  ^(.)  behaves  like  a  linear  function  as 

a  tends  to  a  small  number.  This  property  is  useful  in  our  stability  analysis. 

3.  Dynamic  Modeling  and  Autopilot  Design  Problem  Statement 

Using  the  standard  body-fixed  coordinate  system  [1],  [7]  (i.e.,  the  origin  is  at  the  center 
of  mass  of  the  missile,  the  positive  x-axis  extends  forward  through  the  nose  of  the 
missile,  the  positive  z-axis  extends  downward,  and  the  y-axis  completes  the  right-handed 
triad),  the  following  motion  equations  can  be  established 


p 

P 

P 

n^{P,p,r,c) 

Q 

+ 

<1 

xj 

q 

=  QSd- 

n.^{a,d,q\c) 

+  C(c) 

r 

r 

r 

with 


7  = 


-K 

-K' 

0 

-K 

-J. 

,  C(c)  = 

0 

0 

-K 

-K 

K 

5^ 

0 

and 


(3) 


'n,(/9,p,r;c) 

Ci^P  +  Ci^p  +  CiT 

n2{a,d,q,c) 

= 

C„a+C^a  +  C^^q 

p,r,c) 

_C„/  +  C„^p  +  Qr_ 

The  definition  of  each  variable  can  be  found  in  [1].  As  explicitly  reflected  in  the  above 
equations,  the  yaw-pitch-roll  motion  depends  on  aerodynamic  coefficients/parameters 
(denoted  by  c  here).  The  dynamic  motions  of  the  missile  also  depend  on  angle  of  sideslip 
(y5)  and  angle  of  attack  (a)  as  defined  by 
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jy 

d  =  q-  tan(jd)[pcos(a)  -  rsin(cif)]  + - —  (cos(a)cos((Z>)  +  sin(flr)sin(^)) 

V  cos(p) 

+  — ^  (Q  +  q  +  C,^  S  )cos(a) 

WVcosij3)  " 

P  =  psin(Qr)  -  rcos(flr)  +  r  +  <5^  +  <5^)cos(;5) 

+  cos(^)  sin(^J)  cos(p) 

Also  note  that  the  diagonal  elements  of  the  inertia  matrix  of  the  EMRAAT  missile  under 
investigation  are  =  1.08  slug  *  ft^ ,  J^y  =  70. 13  slug  *  and  =  70.66  slug  *  .\X 

is  seen  that  the  first  diagonal  element,  7^ ,  of  the  inertia  matrix  is  not  “dominant”  as 
compared  with  its  off-diagonal  elements  (Jxy-  Jyx  =0.214slug  *  Physically,  this 

implies  that  the  motions  in  yaw,  pitch  and  roll  are  not  decoupled.  Consequently,  the 
diagonal  assumption  of  the  inertia  matrix  commonly  used  does  not  hold  for  the 
EMRAAT  missiles.  Furthermore,  the  surface  deflections  S^,  ^,and^, cannot  be  adjusted 

directly  and  instantaneously  due  to  time  delay  in  surface  dynamics.  Therefore,  the 
actuator  dynamics  must  be  included  in  the  model. 

In  this  work  we  do  not  assume  that  the  inertia  matrix  is  diagonal.  Moreover,  we  consider 
the  following  model  to  reflect  a  delay  and  nonlinear  relationship  between  the  control 
input  command  and  its  realization: 


(4a) 

3,=(P,i3g)-XrbgV^ 

(4b) 

(4c) 

where  and v,. are  the  control  inputs  for  yaw,  pitch  and  roll  motions,  respectively, 

bp,  bg  and  b^  are  constant  control  gains,  and  <Pp,<Pg  and  ^^are  nonlinear  functions. 
The  missile  autopilot  design  problem  to  be  addressed  is  as  follows: 
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Given  a  set  of  commands  in  terms  of  yaw,  pitch  and  roll  angle  {^*,6*,y/*)and  its 
velocity  design  the  control  input  signals  v^  ,v^mdvjo  automatically  adjust 

the  surface  deflections  such  that  the  actual  yaw,  pitch  and  roll  motions  of  the  missile 
track  the  desired  motions  closely. 

In  practice,  the  desired  orientation  commands  (^,0*,vr*)are  provided  by  the  guidance 
unit  (Figure  1).  The  function  of  the  autopilot  unit  is  to  steer  the  missile  to  track  the  given 
path.  In  this  work,  we  assume  that  the  guidance  commands  (0*,  6*,  y/*)  are  available  for 

control  design. 


4.  Autopilot  for  Orientation  Tracking 


For  later  development,  the  following  variables  are  defined; 


p 

n^{.,c) 

0  = 

e 

,  ty  = 

q 

,  n{.,c)  = 

nm) 

,  M  = 

y. 

r 

Note  that  ©  and  co  share  the  relation  [7] 

CO  =  A(6»,0)0  and  di  =  A©  +  A0  (5) 


where 


Am) 


1  0  -sin(0) 

0  cos(^^)  cos(^)sin(^) 

0  -sin(^)  cos(^)cos(^) 


which  is  non-singular  as  long  as  6^±nl2.  The  case  that  A  becomes  singular  is  known  as 
gimbal  lock.  In  our  analysis,  we  assume  such  unusual  flight/launch  condition  does  not 
occur.  If  the  missile  under  consideration  may  experience  the  gimbal  lock,  a  different 
rotation  order  may  be  employed.  With  the  above  notations,  the  aerodynamics  and  the 
actuator  dynamics  can  be  expressed  as 


0  =  f(.,c)  + g(.,c)u 
u  -  (p{u)  +  bV 


where 


(6) 

(7) 


/(.,c)  =  {JAr^^Sdni.,c)  -  JAB  -  (aq)x  /(a©)}  (7a) 

g(.,c)  =  (JA)-^QSdCic)  (7b) 

y  =  [Vp  v^f  ,<P  =  \.<Pp  %  <Prf  ^  b  =  diag(bp,b^,b^)  (7c) 

To  describe  the  control  strategy,  let  us  define  the  orientation  tracking  error 

e  =  0-0*  (8) 

and  filtered  tracking  error 

s  =  e  +  k^e  (9) 

where  kg  >  0  is  a  constant  chosen  by  the  designer. 


4.1  Inverse  Dynamics  Based  Autopilot 
Theorem  1 

Considering  the  missile  modeled  by  (6)-(7).  If  the  control  input  V  is  generated  by 

V  =  B-\-k^z-A,)  (10) 


where 


z  =  /(0, 0)  +  giB)u  -  0*  +  k,s  +  V 

+  g<p-  'B*  -  {k^  +  ko)0*  +  k^k^e 
B,Q  =  gb 


(11) 

(12a) 

(12b) 


and  k^>0  and  >  0  are  design  constants,  then  asymptotic  orientation  tracking  is 
ensured,  i.e., 0-^0*  and©  — >  0*  as  r ->  <» . 


Proof: 

With  s  and  z  as  defined  in  (9)  and  (1 1),  it  can  be  shown  that 

s  =  -k^s  +  z  (13) 
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where  >  0  is  a  design  constant.  Taking  derivative  of  z  with  respect  to  time  and  using 
(6)-(7)  yields 

j=A(-)+«,(-y  O'*) 

where  A,  and  are  defined  as  in  (12).  Under  the  control  of  V  as  given  in  (10),  it  is 
readily  verified  that 

i  =  -Kz  (15) 

Therefore  the  closed-loop  dynamics  of  the  system  are  governed  by  (9),  (13)  and  (15), 
which  can  be  expressed  compactly  as 
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where  /  €  is  a  unit  matrix.  It  is  seen  that  the  augmented  system  has  the  following 

eigenvalues:  =  -itp,  /l^,.  =  -k^  and  /l^,.  =  -k^  (i  =  1, 2, 3).  Therefore  it  can  be  concluded 

that  e,  5  (hence  e)  and  z  are  asymptotically  stable,  i.e.,  ||z||  ^  0,  ||e||  — >  0  and  ||e||-^0as 
The  result  as  stated  in  the  theorem  is  then  established. 

4.2  Autopilot  with  Memory-based  Compensation 

It  should  be  noted  that  for  dual  range  missiles  system  parameters  may  undergo  significant 
variation  due  to  the  wide  change  of  flight  condition  [8]-[12].  An  example  is  shown  in 
Figure  10,  where  and  Q  are  missile  aerodynamic  force  coefficients  [13].  They  are 
computed  as  a  function  of  Reynolds  number,  angle  of  attack,  and  Mach  number.  It  can  be 
seen  from  Figure  10  that  as  the  angle  of  attack  changes,  €„  and  Q  vary  significantly, 
which  leads  to  unknown  and  varying  system  parameters.  To  reflect  this  fact,  we  consider 
the  general  system  parameter  c  in  the  form 

c  =  Co  +  &(0  (17) 
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(18a) 


and  express  the  dynamic  motions  of  equation  as 

0  =  /()(mCo)  ^l(®’  ®» 

u  =  (p^(u)  +  A^Q  +  bV  (18b) 

where  /„  and  are  the  nominal  functions  associated  with  the  available  system 
modeling  information  whereas  A,  represents  the  unknown  portion  of  the  system  due  to 
unknown  flight  conditions.  As  a  result  the  previously  developed  control  algorithms  are 
not  applicable. 


Figure  10  -  Aerodynamic  force  Coefficients  vs.  angle  of  attack 


It  is  therefore  of  practical  interest  to  develop  the  corresponding  control  scheme  that 
achieves  acceptable  performance  under  varying  flight  conditions.  In  this  work,  it  is 
proposed  to  combine  the  memory-based  compensation  with  partial  inverse  dynamics 
control  to  achieve  this  objective.  As  a  first  step,  we  rewrite  (18a)  as 

i  =  -A:,^  +  Zo+A,  (19) 

where 

Zo  =  /o(®.®)  +  go(®)“  -  (20) 
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and  e  and  s  are  defined  as  before.  Taking  derivative  of  z„with  respect  to  time  and  using 
(18a)-(18b)  gives 


where 


+  -  ©*  -  (*0  +  )®*  + 

B,o  =  8<J> 


(22a) 


(22b) 


A,=(^^+(*o+t.)/jA,+8.A,  (23) 

Note  that  the  control  scheme  previously  developed  is  fairly  complicated  in  that  it 
involves  extensive  analytical  calculation.  Especially,  because  of  the  complexity  of/^,  it 
demands  significant  manipulation  to  analytically  find  A;q  (this  would  be  painful  when 

flight  conditions  vary).  Furthermore,  the  control  scheme  needs  0'  to  be  available,  which 
may  require  a  complicated  guidance  unit  in  the  system.  In  order  to  simplify  on-line 
computations  in  guidance  and  control,  A/q  (and  therefore  0' )  is  not  used  in  our  control 
scheme.  Instead,  we  treat  A  as  part  of  the  lumped  system  uncertainty  as  expressed  below 


A  =  A;o  +  A2 


For  such  a  lumped  uncertainty,  we  consider  two  cases: 

•  Case  I-  A  is  unknown  and  slowly  time  varying,  i.e., 

Ik^ll  n 

•  Case  2  -Ais  unknown  and  fast  time-varying  in  that 


h=  v,  <  00 


(24a) 


(24b) 


(24c) 


In  addition,  we  assume  that  there  exists  a  constant  e^  such  that 


(24d) 
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Remark 


For  a  missile  undergoing  no  abrupt  change  of  flight  condition,  it  seems  reasonable 
to  make  the  above  assumption  (24b)  or  (24c)  on  A  because  its  variation  cannot  be 
infinitely  fast.  The  condition  of  (24d)  is  also  necessary  for  the  system  to  admit  a 
feasible  control  strategy. 

The  proposed  control  scheme  is  given  as  follows 

V  =  (25) 

where  denotes  the  memory-based  compensation.  For  simplicity,  we  consider  the 
following  first  order  memory-based  control, 

with 

(*  - 1)  +  w,2o(^)  +  ^2^0  - 1)  (26b) 

where  w^,  w,,  and  W2  are  the  memory  coefficients  to  be  (determined.  It  is  seen  that  only 
one  step  back  control  history  and  system  response  are  needed  in  the  scheme. 

Theorem  2 

Consider  the  missile  model  with  lumped  uncertainty  due  to  varying  flight  conditions  as 
described  in  by  (18)  and  (24).  Let  the  control  input  be  generated  by  (25)  with  the 
memory-based  compensation  (26a).  If  the  memory  coefficients  are  given  by 

Wo=l,  w,=(2-Tfe,)/r,  W2  =  iTk^-l)/T  (26c) 

where  T  is  the  sampling  period,  then  the  missile  orientation  tracks  the  desired  orientation 
with  bounded  error. 

Proof: 


1  +  e 


■oy 


(26a) 
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We  first  prove  that  ||zo||  is  bounded.  With  the  control  of  (25),  it  follows  from  (21)  that 


Zo=-Mo  +  ^-K. 

For  a  small  sampling  period  T,  using  Euler  formula  (27)  can  be  expressed  as 
+ 1) = (1  -  KT)z,ijc) + nm  -  v^ik)) 

With  one  step  back  time  shift,  we  get 

z,{k)  =  {\- kj)z, ik-l)  +  mik  -l)-VJk- 1)) 

Subtracting  (29)  from  (28)  gives 

Zo  (^  + 1)  =  (2  -  k^T)Zo  (k)  +  {kj  - 1)^0 {k  - 1) 

+  T{l{k)  -  Mk  -  D)  -  7’(V'„  (^)  -  (k  -  D) 


(27) 


(28) 


(29) 


(30) 


Upon  using  (26a)-(26c)  and  using  the  property  of  ^(.)  with  cr  small  enough,  it  can  be 
shown  that 

Zoik  +  l)  =  T(Mk)-kk-l))  (31) 

Note  that  for  a  sufficiently  small  sampling  period  T, 

||A(fe)-A(*-l)||<rsup,,o 

Therefore,  it  is  seen  from  (31)  that  under  the  conditions  (24b) 

||zo(A:  +  l)||  =  0  V^>1 

and  under  the  condition  (24c) 

||zo(it  +  l)||<rV,<oo  Vit>l 

Thus  for  both  cases  it  can  be  concluded  that  bounded.  In  view  of  (19)  and  the 
assumption  (24d),  it  is  readily  established  that  l^l ,  and  therefore,  ||e||  and  ||e||  are  bounded. 


dA 

dt 


=  Tv, 
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Remarks 


1)  It  is  interesting  to  note  that  the  proposed  memory-based  control  turns  out  to  be  fairly 
simple  as  compared  to  the  one  developed  previously.  One  only  needs  to  select  the 
control  parameters  and  . 

2)  Also  note  that  the  proposed  scheme  is  essentially  a  partial  inverse  dynamics  control 
plus  a  memory-based  control.  There  is  no  need  to  carry  out  the  rather  complicated 
manipulations/procedures  to  analytically  find  Ajq  ,  only  3,^  is  used,  which  makes  the 
design  and  real-time  implementation  more  feasible. 

3)  Also  note  that  since  the  control  algorithm  does  not  involve  v',  or  f , ,  no  estimation  of 
such  parameters  is  needed. 


5.  Autopilot  for  Position  and  Orientation  Tracking 

The  previous  control  algorithms  are  designed  for  pure  missile  orientation  control.  In  this 
section  the  algorithms  are  extended  to  a  more  general  case  where  a  rigid  body  missile 
undergoes  both  position  and  orientation  maneuvers  simultaneously.  In  such  a  case,  the 
dynamic  behavior  of  the  missile  can  be  characterized  by  [7], 

P^-Rf  (32a) 

m 

0  =  (/a)'*  (r*  -  A0  X  JA®  -  7A0)  (32b) 

where  P  =  \px  Py  is  the  position  vector  of  the  center  of  mass;  ®  =  \^  6  y/J  is  the 
vector  of  yaw,  pitch,  and  roll  Euler  angles;  R{fl),9,ij/)  is  the  3x3  rotation  matrix; 
A{9,  (j>)  is  a  3x3  matrix;  J  is  the  constant  moment  of  inertia  matrix;  /*  =  [//  fy 

is  the  3x1  force  vector  in  the  body  frame;  andr*  =  [r*  r*  r* f  is  the  3x1  torque  vector 
in  the  body  frame.  Note  that  /*  and  r*  are  to  be  controlled  by  the  fin  kinematics,  such 
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as  flapping  frequency  n ,  the  maximum  stroke  angle,  the  angle  of  attack,  and  fin  rotation 
time,  etc.  To  reflect  this  fact,  we  denote  /*  and  r*  as 


=  N{u) 


where  «  is  a  virtual  control  variable.  Since  «  cannot  be  adjusted  directly,  the  following 


actuator  dynamics 

u  =  (piu)  +  bV  (33) 

is  included  as  part  of  the  system  model,  where  b  is  the  control  influence  gain  matrix  and 
V  is  the  control  input.  The  control  problem  under  investigation  is  stated  as  follows: 
Design  V  such  that  the  missile  flying  position  and  orientation  ( P,  0 )  closely  track  the 

guidance  commands  (P*,0*).  Mathematically,  the  task  is  to  derive  algorithm  for  V  so 


that 


P-P 

0-0* 


■0 


as  t  —>o°  or 


P-P* 

.  <  f  as  /  — >  oo 
0-0* 


5.1  Inverse  Dynamics  Based  Autopilot  for  Position  and  Orientation  Tracking 

Considering  both  position  and  orientation,  (32)  can  be  expressed  as 
Y  =  h{Y,Y)  +  M(y,u) 


where 


Y  =  [P  0]’' 


and 


h{Y,Y) 


0 

(JA)"'  (-  A0  X  /A0  -  7A0) 


M{Y,u) 


m 

0 


0 

(iA)-‘ 


mu) 


(34) 

(35) 

(36) 


(37) 


Define  the  tracking  error  (e)  and  the  filtered  tracking  error  (5)  by 
e  =  Y-Y* 


(38) 
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and 


s  =  e  +  kQe  (39) 

respectively,  where  >ois  a  design  constant.  Taking  derivative  of  s  with  respect  to  time 
yields 

s  =  h(j,Y)  +  M{Y,u)-Y* +  (40) 

where  the  equation  (34)  has  been  used.  Virtually,  we  need  to  design  u  to  achieve  the 
tracking  objective.  However,  since  u  enters  into  the  system  in  a  nonlinear  way,  u  cannot 
be  designed  directly.  In  fact,  u  is  governed  by  the  actuator  dynamics  (33),  which  can  be 
influenced  by  adjusting  the  control  variable  V.  To  this  end,  we  rewrite  (40)  as 

s  =  -k^s  +  z  (41a) 

where 

z  =  h(Y,Y)  +  M(Y,u)-Y*  +k,s  +  koe  (41b) 

and  ife,  >  0  is  a  design  constant.  It  is  seen  from  (41a)  that  if  z  tends  to  zero  as  t  — >  o®, 
then  s  —>0.  Consequently  it  follows  from  (39)  that  e—>0  and  e  — > 0 as  t  — > <» . 
Therefore,  we  focus  on  stabilizing  z  in  what  follows.  Taking  derivative  of  z  with 
respect  to  time,  gives 


dh  •  dh-  dM  •  dM  . 
— y+— y+-— y+-— M 

8y  ay  ay  a« 


■  y  ’  +  k.S  +  kr£ 


Using  (33),  (34)  and  (40),  we  can  further  express  (42)  as 

i  =  A,  (•)+«,,(> 

where 


(43a) 

(43b) 

(43c) 
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Now  the  control  input  V  is  designed  such  that 

where  k^>0  is  a  design  constant.  It  can  be  verified  that  such  a  controller  leads  to 
z  =  -k^z 

i.e.,  z  — »  0  as  r  — > .  To  summarize,  we  have  the  following  theorem. 

Theorem  3 

Considering  the  missile  dynamics  described  by  (32).  If  the  control  input  V  is  given  by 
(44),  where  z  is  calculated  by  (41b),  and  A„  and  B„  are  determined  as  in  (43b)  and 

(43c),  then  both  P  and  0  track  the  guidance  commands  P*  and  0*  asymptotically. 

Proof; 

With  the  proposed  control,  it  can  be  shown  that  the  closed-loop  system  dynamics  become 

e  =  -k^e  +  s 
s  =  -k^s  +  z 
z  =  -k^z 

which  can  be  expressed  compactly  as 

kj  I  0  T^' 

0  -kj  I  s 
0  0  -  kj  z 

where  /e  P®’'®is  a  unit  matrix.  It  is  seen  that  the  augmented  system  has  the  following 
eigenvalues:  =  -k^ ,  A^^  =  -k^ ,  A^  =  -k^  (i  =  1,2,. ..,6) .  Therefore  it  is  concluded  that 
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e,  e  and  z  are  asymptotically  stable,  i.e.,  ||zll-»0,  |e||->0and  pl^Oas  The 

result  as  stated  in  the  theorem  is  then  established. 

5.2  Autopilot  with  Memory-based  Compensation 

Due  to  varying  flight  condition,  the  aerodynamics  and  actuator  dynamics  of  dual  range 
missiles  become 

Y  =  ^(y,F;Co)  +  Mo(T,m)  +  Ahm  (46) 

and 


u  =  <p,iu)  +  bV  +  A^iu,t)  (47) 

In  such  a  case  the  control  algorithms  developed  in  Section  5.1  are  not  applicable.  It  is 
interesting  to  note  that  the  memory-based  control  previously  developed  for  orientation 
tracking  can  be  extended  to  cover  this  situation.  To  show  this,  we  rewrite  (46)  as 

s  =  -k^s  -I-  Zo  +  (48) 

where 

Zo  =  K(Y,Y)  +  M,(Y,u)  -r  +  k,e  +  k^s  (49) 

Taking  derivative  of  with  respect  to  time  and  using  (46)-(47),  we  have 


where 


Zq  —  -f  (A,,o  +  A2) 


A„o=f— +  — V  +  f^  +  (^  +it,)/V+Mo) 

[dY  BY  j  *  J 

+^<p,-r  -{k,^K)r +k^k,e 

ou 


du 

A,  +  +*:■)' 


J 


A  ^^0  A 

“  du  ' 


The  proposed  memory-based  control  is  of  the  form 


(50) 


(51a) 


(51b) 

(52) 
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V  =  B,V„(-tA-V'.) 


(53) 


where  is  generated  by  a  memory-based  unit  to  be  specified.  Note  that  to  simplify  the 
design  procedure  and  on-line  computation,  A^gis  not  used  as  part  of  the  control  input. 
The  effect  of  A„q  ,  together  with  that  of  Aj ,  is  to  be  compensated  by  .  Let 
A  =  A„o-hA2be  the  lumped  uncertainty  of  the  system.  Since  A  is  unknown  and  time- 
varying,  the  proposed  control  only  uses  the  following  information  on  A : 

•  Case  I-  A  is  unknown  and  slowly  time-varying  such  that 

dt 

•  Case  II  -  A  is  unknown  and  time-varying  such  that 

(54b) 

In  addition,  we  assume  that  \\A^^f  ||  is  bounded  by  a  constant  in  that 

1A„||<S,<».  (54c) 

Now  we  are  ready  to  state  the  following  result. 


=  1/2  »0 


(54a) 


Theorem  4 


Consider  the  missile  model  as  described  by  (46)-(47)  with  lumped  uncertainty  satisfying 
(54).  If  the  control  input  is  generated  by  (53)  with  the  memory-based  compensation 


\^i-r  e  j 


(55a) 


y  =  -  l)+  >V,Zo(^)+  -l) 

where  the  memory  coefficients  Wq,  Wj,  and  W2  are  given  by 


(55b) 


Wo=l,  w,  =  (2-rk,)/r,  w.^iTk^-DIT 


(55b) 


then  the  position  and  orientation  of  the  missile  track  the  guidance  commands  with 
bounded  error. 

Proof: 

The  result  can  be  justified  following  the  same  procedures  as  in  the  proof  of  Theorem  2. 


Figure  11  -  Autopilot  with  memory-based  compensation 

The  autopilot  control  block  diagram  with  memory-based  compensation  is  depicted  in 
Figure  11.  It  is  seen  that  only  one-step  back  control  history  and  system  response  are 
needed  in  the  scheme.  It  is  also  stressed  that  the  proposed  memory-based  compensation 
method  does  not  involve  1^2  or  and  no  calculation/estimation  of  such  parameters  is 
needed.  Only  three  control  parameters  ,  k^  and^^  are  to  be  selected. 

6.  Performance  Evaluation 

To  verify  the  effectiveness  of  the  proposed  control  algorithms,  simulations  under  various 
flight  conditions  were  conducted.  This  section  presents  some  of  the  results.  For 
simplicity,  the  pure  orientation  tracking  is  considered.  Namely,  the  tracking  performance 


of  the  developed  control  algorithms  for  the  case  of  yaw,  pitch,  and  roll  motions  is  tested. 
Figure  12  is  the  control  block  diagram  for  this  case.  The  nominal  flight  conditions 
simulated  are:  air  density  p  =  5.Sle'^slugl  ft^ ,  Altitude  =30,000^?,  Mach  number 
M  =2.0.  The  control  parameters  are  k,,  =15,  =15,  and  =15.  Since  the  flight 

conditions  vary  during  the  missile  flight,  the  following  parameters  are  used  in  the 
simulation  model: 


c  =  Cq+Sc 

For  instance,  the  air  pressure  is  of  the  form 

Q  =  Qo  +  ^ 

where  given  as  in  [1],  but  SQ  varies  with  time.  To  reflect  the  fact  of  varying  flight 
conditions,  the  dynamic  parameters  and  and  the  flight  speed  V  as  well  as  the 

air  pressure  Q  as  shown  in  Figures  13-16  were  used  for  the  test.  The  desired  trajectory 
for  the  orientation  is 


1 

O 

1 

0*  = 

- 

30(1 -e") 

(degree) 

W* 

20(1 -e"') 
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The  simulation  results  are  shown  in  Figures  17-21,  where  tracking  performance  is  shown 
in  Figures  17-19.  It  can  be  seen  that  the  actual  trajectory  of  missile  tracks  the  guidance 
commands  closely  and  timely.  Figures  20-21  are  the  angle  of  attack  and  angle  of  the 
sideslip.  All  the  control  signals  are  indeed  smooth  and  bounded. 

7.  Conclusion  and  Discussion 

This  project  has  investigated  a  memory-based  approach  for  autopilot  control  of  missile 
systems.  The  control  scheme,  purely  built  upon  past  control  experience  and  most  recent 
system  responses,  is  quite  effective  in  dealing  with  system  nonlinearities,  modeling 
uncertainties  and  external  disturbances.  The  proposed  method  demonstrates  robust  and 
adaptive  properties,  while  these  properties  are  achieved  through  an  avenue  somewhat 
different  from  traditional  methods  -  there  is  no  need  for  parameter  estimation,  repetitive 
actions,  infinite  switching  frequencies,  ad  hoc  design  process  or  extensive  off-line 
training.  It  is  noted  that  the  structure  of  the  controller  remains  unchanged  for  different 
nonlinear  functions  A  (.)(due  to  the  change  of  flight  conditions).  Furthermore,  the 

memory  size  does  not  grow  with  time,  which  could  significantly  facilitate  real-time 
implementation.  While  memory-based  approach  for  solving  engineering  problems  has  a 
long  history,  applying  this  method  to  control  systems  is  a  new  attempt.  Our  current 
results  show  that  memory-based  control  has  potential  for  missile  control  applications.  In 
this  work,  we  investigated  a  method  for  autopilot  design  of  missile  system.  It  is  shown 
that,  with  the  proposed  control  algorithms,  stable  trajectory  tracking  is  ensured.  Unlike 
most  existing  work,  where  the  actuator  dynamics  are  ignored,  we  explicitly  considered 
the  effects  of  the  actuator  dynamics,  which  play  an  important  role  in  system  performance. 
The  variation  of  aerodynamic  coefficients  due  to  varying  flight  conditions  is  considered 
in  deriving  the  control  algorithms.  The  effectiveness  of  the  proposed  control  strategy  has 
been  verified  via  computer  simulation. 
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aerodynamic 


Figure  13  -  The  variation  of  C  with  flight  conditions 


Figure  14  -  The  variation  of  with  flight  conditions 
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Euter  Angl«  (Dvgre#) 


Figure  18  —  Euler  angle  tracking  error 


Figure  19  —  Angular  velocity  tracking  error 


Figure  21  —  Angle  of  sideslip  vs.  time 
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